Method and apparatus for encoding/decoding image

ABSTRACT

A method for decoding an image, according to the present invention, comprises the steps of: receiving image information that corresponds to a block to be decoded; performing entropy-decoding with respect to the image information that is received; deciding a transform skip mode of the block to be decoded from a plurality of transform skip mode candidates, based on the image information that is entropy-decoded; and reverse-transforming the block to be decoded based on the transform skip mode that is decided.

CROSS REFERENCE TO PRIOR APPLICATIONS

The present application is a Continuation of pending U.S. patentapplication Ser. No. 14/353,288 (filed on Apr. 21, 2014), which is aNational Stage Patent Application of PCT International PatentApplication No. PCT/KR2012/008482 (filed on Oct. 17, 2012) under 35U.S.C. §371, which claims priority to Korean Patent Application No.10-2011-0106107 (filed on Oct. 17, 2011), the teachings of which areincorporated herein in their entireties by reference.

BACKGROUND

The present invention relates to image processing, and moreparticularly, to a transform method and a transform apparatus.

Recently, demands for high-resolution and high-quality videos, such ashigh-definition (HD) and ultrahigh-definition (UHD) videos, areincreasing.

To provide videos with higher resolution and higher quality, the amountof video data increases. Accordingly, costs of transferring and storingvideo data rise so as to provide high-quality videos as compared withconventional video data processing methods. In order to solve theseproblems occurring with an increase in resolution and quality of videodata, high-efficiency video compression techniques may be utilized.

As video data compression technology, various schemes are used such asinter prediction that is dependent on data elements of pictures otherthan the current picture, intra prediction that is derived from onlydata elements of the same decoded slice, and entropy encoding/decodingof allocating shorter codes to frequently occurring or appearingsignals.

SUMMARY

An aspect of the present invention is to provide a video encoding methodand a video encoding apparatus which are capable of increasing videoencoding performance.

Another aspect of the present invention is to provide a video decodingmethod and a video decoding apparatus which are capable of increasingvideo decoding performance.

Still another aspect of the present invention is to provide a transformmethod and a transform apparatus which are capable of increasing videoencoding performance.

Yet another aspect of the present invention is to provide an inversetransform method and an inverse transform apparatus which are capable ofincreasing video decoding performance.

Yet another aspect of the present invention is to provide a scanningmethod and a scanning apparatus which are capable of increasing videoencoding performance.

Yet another aspect of the present invention is to provide an inversescanning method and an inverse scanning apparatus which are capable ofincreasing video decoding performance.

An embodiment of the present invention provides a video decoding method.The method may include receiving information on a picture correspondingto a decoding target block, entropy-decoding the information on thepicture, determining a transform skip mode (TSM) for the decoding targetblock among a plurality of TSM candidates based on the entropy-decodedinformation on the picture, and inverse-transforming the decoding targetblock based on the determined TSM. Here, the TSM candidates may includeat least one of a 2-directional (2D) transform mode of performing bothhorizontal transform and vertical transform, a horizontal transform modeof performing horizontal transform, a vertical transform mode ofperforming vertical transform and a non-transform mode of not performingtransform.

The information on the picture may include information on a predictionmode corresponding to the decoding target block and a type of aprediction unit (PU) corresponding to the decoding target block.

When the prediction mode corresponding to the decoding target block isan inter mode and the type of the PU corresponding to the decodingtarget block is N×2N, N being a natural number, the vertical transformmode may be allocated a shorter codeword than the horizontal transformmode.

When the prediction mode corresponding to the decoding target block isan inter mode and the type of the PU corresponding to the decodingtarget block is 2N×N, N being a natural number, the TSM candidates mayinclude the 2D transform mode, the horizontal transform mode and thenon-transform mode except for the vertical transform mode.

When the prediction mode corresponding to the decoding target block isan inter mode and the type of the PU corresponding to the decodingtarget block is N×2N, N being a natural number, the TSM candidates mayinclude the 2D transform mode, the vertical transform mode and thenon-transform mode except for the horizontal transform mode.

When the prediction mode corresponding to the decoding target block is ashort distance intra prediction (SDIP) mode and the type of the PUcorresponding to the decoding target block is 2N×(1/2)N, N being anatural number that is 2 or greater, the TSM candidates may include the2D transform mode, the horizontal transform mode and the non-transformmode except for the vertical transform mode.

When the prediction mode corresponding to the decoding target block isan SDIP mode and the type of the PU corresponding to the decoding targetblock is (1/2)N×2N, N being natural number that is 2 or greater, the TSMcandidates may include the 2D transform mode, the vertical transformmode and the non-transform mode except for the horizontal transformmode.

The information on the picture may include information on a predictionmode corresponding to the decoding target block and a predictiondirection of a PU corresponding to the decoding target block.

When the prediction mode corresponding to the decoding target block isan intra mode and the prediction direction of the PU corresponding tothe decoding target block is a vertical direction, the verticaltransform mode may be allocated a shorter codeword than the horizontaltransform mode.

The video decoding method may further include determining a scanningmode for the decoding target block based on the determined TSM, andinverse-scanning the decoding target block based on the determinedscanning mode.

The determining of the scanning mode may determine a vertical scanningmode as the scanning mode when the determined TSM is the horizontaltransform mode.

The determining of the scanning mode may determine a horizontal scanningmode as the scanning mode when the determined TSM is the verticaltransform mode.

Another embodiment of the present invention provides a video decodingapparatus. The apparatus may include an entropy decoding module toreceive information on a picture corresponding to a decoding targetblock and to entropy-decode the information on the picture, and aninverse transform module to determine a TSM for the decoding targetblock among a plurality of TSM candidates based on the entropy-decodedinformation on the picture and to inverse-transform the decoding targetblock based on the determined TSM. Here, the TSM candidates comprise atleast one of a 2D transform mode of performing both horizontal transformand vertical transform, a horizontal transform mode of performinghorizontal transform, a vertical transform mode of performing verticaltransform and a non-transform mode of not performing transform.

Still another embodiment of the present invention provides a videoencoding method. The method may include generating a residual blockcorresponding to an encoding target block, determining a TSM for theencoding target block among a plurality of TSM candidates; andtransforming the residual block based on the determined TSM. Here, theTSM candidates may include at least one of a 2D transform mode ofperforming both horizontal transform and vertical transform, ahorizontal transform mode of performing horizontal transform, a verticaltransform mode of performing vertical transform and a non-transform modeof not performing transform.

A prediction mode corresponding to the encoding target block may be aninter mode, and the determining of the TSM may determine the TSM basedon a type of a PU corresponding to the encoding target block.

A prediction mode corresponding to the encoding target block may be anSDIP mode, and the determining of the TSM may determine the TSM based ona type of a PU corresponding to the encoding target block.

A prediction mode corresponding to the encoding target block may be anintra mode, and the determining of the TSM may determine the TSM basedon intra prediction mode direction of a PU corresponding to the encodingtarget block.

The video encoding method may further include determining a scanningmode for the encoding target block based on the determined TSM, andscanning the encoding target block based on the determined scanningmode.

Yet another embodiment of the present invention provides a videoencoding apparatus. The apparatus may include a residual blockgenerating module to generate a residual block corresponding to anencoding target block, and a transform module to determine a TSM for theencoding target block among a plurality of TSM candidates and totransform the residual block based on the determined TSM. Here, the TSMcandidates may include at least one of a 2D transform mode of performingboth horizontal transform and vertical transform, a horizontal transformmode of performing horizontal transform, a vertical transform mode ofperforming vertical transform and a non-transform mode of not performingtransform.

According to a video encoding method of the present invention, videoencoding performance may be enhanced.

According to a video decoding method of the present invention, videodecoding performance may be enhanced.

According to a transform/inverse transform method of the presentinvention, video encoding/decoding performance may be enhanced.

According to a scanning/inverse scanning method of the presentinvention, video encoding/decoding performance may be enhanced.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a configuration of a videoencoding apparatus according to an exemplary embodiment of the presentinvention.

FIG. 2 is a block diagram illustrating a configuration of a videodecoding apparatus according to an exemplary embodiment of the presentinvention.

FIG. 3 schematically illustrates a transform method based on a transformmode according to an exemplary embodiment of the present invention.

FIG. 4 is a flowchart schematically illustrating a transform process ofthe encoding apparatus according to an exemplary embodiment of thepresent invention.

FIG. 5 is a flowchart schematically illustrating an inverse transformprocess of the decoding apparatus according to an exemplary embodimentof the present invention.

FIG. 6 illustrates a method of determining a transform skip modecandidate and a method of allocating a codeword to a transform skip modeaccording to a PU form in an inter mode.

FIG. 7 illustrates a method of determining a transform skip modecandidate and a method of allocating a codeword to a transform skip modeaccording to a PU form in SDIP.

FIG. 8 illustrates a method of allocating a codeword to a transform skipmode according to intra prediction mode directions.

FIG. 9 schematically illustrates a method of scanning a transformcoefficient based on a transform skip mode according to an exemplaryembodiment of the present invention.

FIG. 10 is a flowchart schematically illustrating an encoding methodaccording to an exemplary embodiment of the present invention.

FIG. 11 is a flowchart schematically illustrating a decoding methodaccording to an exemplary embodiment of the present invention.

DETAILED DESCRIPTION OF EMBODIMENTS

Although elements illustrated in the drawings are independently shown soas to represent different distinctive functions in a video encodingapparatus/decoding apparatus, such a configuration does not indicatethat each element is constructed by a separate hardware constituent orsoftware constituent. That is, the elements are independently arrangedfor convenience of description, wherein at least two elements may becombined into a single element, or a single element may be divided intoa plurality of elements to perform functions. It is to be noted thatembodiments in which some elements are integrated into one combinedelement and/or an element is divided into multiple separate elements areincluded in the scope of the present invention without departing fromthe essence of the present invention.

Hereinafter, exemplary embodiments of the invention will be described indetail with reference to the accompanying drawings. Like referencenumerals in the drawings refer to like elements throughout, andredundant descriptions of like elements will be omitted herein.

FIG. 1 is a block diagram illustrating a configuration of a videoencoding apparatus according to an exemplary embodiment of the presentinvention. Referring to FIG. 1, the video encoding apparatus may includea picture partitioning module 110, an inter prediction module 120, anintra prediction module 125, a transform module 130, a quantizationmodule 135, a dequantization module 140, an inverse transform module145, a module filter 150, a memory 155, a rearrangement module 160 andan entropy encoding module 165.

The picture partitioning module 110 may divide an input picture into oneor more coding units. A coding unit (CU) is a unit of encoding conductedby the video encoding apparatus and may be recursively subdivided withdepth information based on a quadtree structure. A CU may have differentsizes of 8×8, 16×16, 32×32 and 64×64. A CU with a maximum size isreferred to as a largest coding unit (LCU), and a CU with a minimum sizeas a smallest coding unit (SCU).

The picture partitioning module 110 may divide a CU to generate aprediction unit (PU) and a transform unit (TU). A PU may be smaller thanor the same as a CU, and may not necessarily be a square block but be arectangular block.

Generally, intra prediction may be performed by 2N*2N or N*N blocks.Here, N is a natural number, representing a number of pixels, and 2N*2Nor N*N may represent a PU size (and/or partition mode). However, inshort distance intra prediction (SDIP), not only a 2N*2N PU but asubdivided PU with a size of hN*2N/2N*hN (here, h=1/2) may be also usedto increase efficiency in intra prediction. When an hN*2N/2N*hN PU isused, directivity of a boundary in a block may be further reflected, andaccordingly energy of a prediction error signal may be decreased toreduce bit numbers needed for encoding, thereby increasing encodingefficiency.

Inter prediction may be performed by 2N*2N, 2N*N, N*2N or N*N blocks.Here, N is a natural number, representing a number of pixels, and 2N*2N,2N*N, N*2N or N*N may represent a PU size (and/or partition mode).Further, inter prediction may be performed by 2N×nU, 2N×nD, nL×2N ornR×2N PUs, in addition to the 2N*2N, 2N*N, N*2N or N*N PUs, in order toenhance efficiency in inter prediction. Here, 2N×nU, 2N×nD, nL×2N ornR×2N may represent a PU size (and/or partition mode). In 2N×nU and2N×nD partition modes, a PU may have a size of 2N×(1/2)N or 2N×(3/2)N,while in nL×2N and nR×2N partition modes, a PU may have a size of(1/2)N×2N or (3/2)N×2N.

In an inter prediction mode, the inter prediction module 120 may performmotion estimation (ME) and motion compensation (MC). The interprediction module 120 may generate a prediction block based oninformation on at least one of previous and subsequent pictures of thecurrent picture.

The inter prediction module 120 may perform motion estimation based on adivided prediction target block and at least one reference block storedin the memory 155. The inter prediction module 120 may generate motioninformation including a motion vector (MV), a reference block index anda prediction mode as a result of motion estimation.

Further, the inter prediction module 120 may perform motion compensationusing the motion information and the reference block. Here, the interprediction module 120 may generate and output a prediction blockcorresponding an input block from the reference block.

In an intra prediction mode, the intra prediction module 125 maygenerate a prediction block based on information on a pixel in thecurrent picture. In the intra prediction mode, the intra predictionmodule 125 may perform prediction for a current block based on aprediction target block and a reconstructed block previouslyreconstructed via transformation and quantization. Here, thereconstructed block may be a reconstructed picture that has not beensubjected to the filter module 150.

In the inter prediction mode or intra prediction mode described above,prediction may be performed on a prediction target block to generate aprediction block. Here, a residual block may be generated bydifferentiation between the prediction target block and the generatedprediction block.

The transform module 130 may transform a residual block by a TU togenerate a transform coefficient. A TU may have a tree structure withinmaximum and minimum sizes. It may be indicated through a flag whether acurrent block is partitioned into sub-blocks by each TU. The transformmodule 130 may perform transform based on a discrete cosine transform(DCT) and/or discrete sine transform (DST).

The quantization module 135 may quantize values transformed by thetransform module 130. A quantization coefficient may change based on ablock or importance of a picture. The quantized transform coefficientmay be provided to the rearrangement module 160 and the dequantizationmodule 140.

The rearrangement module 160 may arrange a two-dimensional (2D) block ofthe quantized transform coefficients into a one-dimensional (1D) vectorof transform coefficients by scanning so as to enhance efficiency inentropy encoding. The rearrangement module 160 may change scanning orderbased on stochastic statistics to enhance entropy encoding efficiency.

The entropy encoding module 165 may entropy-encode the values obtainedby the rearrangement module 160. In entropy encoding, a more frequentlyoccurring syntax element value may be allocated a codeword of smallerbit numbers, while a less frequently occurring syntax element value maybe allocated a codeword of more bit numbers. Thus, a size of a bitstring for symbols to be encoded may be reduced to enhance videoencoding compression performance. Various encoding methods, such asexponential Golomb coding, context-adaptive variable length coding(CAVLC) and/or context-adaptive binary arithmetic coding (CABAC), may beused for entropy encoding. The encoded information may be formed into acompressed bitstream and be transferred or stored through a networkabstraction layer (NAL).

The dequantization module 140 may dequantize the transform coefficientsquantized by the quantization module 135, and the inverse transformmodule 145 may generate a reconstructed residual block toinverse-transform the dequantized transform coefficients. Thereconstructed residual block may be merged with the prediction blockgenerated by the inter prediction module 120 or the intra predictionmodule 125 to generate a reconstructed block. The reconstructed blockmay be provided to the intra prediction module 125 and the filter module150.

The filter module 150 may filter the reconstructed residual block usinga deblocking filter, a sample adaptive offset (SAO) and/or an adaptiveloop filter (ALF). The deblocking filter may filter the reconstructedblock so as to remove a distortion on boundaries between blocksoccurring in encoding and decoding. The SAO is a loop filtering processto be performed on the residual block via the deblocking filter toreconstruct an offset difference from an original picture by a pixel. Aband offset and an edge offset may be used as the SAO. The band offsetmay divide a pixel into 32 bands according to intensity and applyoffsets to two divided groups of 16 bands on an edge area and 16 bandsin a central area. The ALF may perform filtering so as to minimize anerror between the prediction target block and the finally reconstructedblock. The ALF may perform filtering based on a value obtained bycomparing the reconstructed block filtered by the deblocking filter withthe current prediction target block, and filter coefficient informationon the ALF may be loaded onto a slice header and transferred from theencoding apparatus to the decoding apparatus.

The memory 155 may store the finally reconstructed block via the filtermodule 150, and the finally reconstructed block may be provided to theinter prediction module 120 performing inter prediction.

FIG. 2 is a block diagram illustrating a configuration of a videodecoding apparatus according to an exemplary embodiment of the presentinvention. Referring to FIG. 2, the video decoding apparatus may includean entropy decoding module 210, a rearrangement module 215, adequantization module 220, an inverse transform module 225, an interprediction module 230, an intra prediction module 235, a filter module240 and a memory 245.

The entropy decoding module 210 may receive a compressed bitstream froman NAL. The entropy decoding module 210 may entropy-decode the receivedbitstream, and also entropy-decode a prediction mode and motion vectorinformation if the bitstream includes the prediction mode and the motionvector information. When entropy decoding is used, a more frequentlyoccurring syntax element value may be allocated a codeword of smallerbit numbers, while a less frequently occurring syntax element value maybe allocated a codeword of more bit numbers. Thus, a size of a bitstring for symbols to be encoded may be reduced to enhance videoencoding compression performance.

An entropy-decoded transform coefficient or residual signal may beprovided to the rearrangement module 215. The rearrangement module 215may inverse-scan the decoded transform coefficient or residual signal togenerate a 2D block of transform coefficients.

The dequantization module 220 may dequantize the rearranged transformcoefficients. The inverse transform module 225 may inverse-transform thedequantized transform coefficients to generate a residual block.

The residual block may be merged with a prediction block generated bythe inter prediction module 230 or intra prediction module 235 togenerate a reconstructed block. The reconstructed block may be providedto the intra prediction module 235 and the filter module 240. The interprediction module 230 and the intra prediction module 235 performsoperations the same as or equivalent to those of the inter predictionmodule 120 and the intra prediction module 125 of the video encodingapparatus, and thus descriptions thereof will be omitted herein.

The filter module 240 may filter the reconstructed block using adeblocking filter, an SAO and/or an ALF. The deblocking filter mayfilter the reconstructed block to remove a distortion on a boundarybetween blocks that occurs in encoding and decoding. The SAO may beapplied to the reconstructed block filtered by the deblocking filter bya pixel to reduce a difference from an original picture. The ALF mayfilter the reconstructed block via the SAO so as to minimize an errorbetween the prediction target block and the finally reconstructed block.

The memory 245 may store the finally reconstructed block obtainedthrough the filter module 240, and the stored reconstructed block may beprovided to the inter prediction module 230 performing inter prediction.

Hereinafter, a block may refer to a video encoding and decoding unit.Thus, in this description, a block may mean a CU, PU, TU and the like.Also, a encoding/decoding target block may collectively include atransform/inverse transform target block, if transform/inverse transformis conducted; a prediction target block, if prediction is conducted; andthe like.

As described above with reference to FIGS. 1 and 2, the encodingapparatus may perform transform on a residual block by a TU, and thedecoding apparatus may inverse-transform dequantized transformcoefficients to generate a reconstructed residual block. In thefollowing description, inverse-transform may be also termed “transform”for convenience as necessary, which will be easily understood by aperson having ordinary knowledge in the art.

The encoding apparatus and the decoding apparatus may perform2-directional (2D) transform including vertical transform and horizontaltransform. However, when vertical and horizontal signals have remarkablydifferent characteristics, vertical transform or horizontal transformmay be omitted. Also, the entire transform process may be omitted for asparse signal. Such transform methods may reduce complexity in thedecoding apparatus and improve encoding efficiency.

Hereinafter, a transform mode involving both horizontal transform andvertical transform is referred to as a “2D transform mode.” A transformmode involving horizontal transform only without vertical transform isreferred to as a “horizontal transform mode,” and a transform modeinvolving vertical transform only without horizontal transform isreferred to as a “vertical transform mode.” Further, a transform modeinvolving neither horizontal transform nor vertical transform isreferred to as a “non-transform mode.” Here, the non-transform mode maybe also referred to as a “transform bypass mode.”

FIG. 3 schematically illustrates a transform method based on a transformmode according to an exemplary embodiment of the present invention.

Square blocks 310 to 340 shown in FIG. 3 are transform target blocks.Here, the transform target blocks may be TUs and/or CUs. Also, arrowsmarked on the blocks 310 to 330 may indicate transform directions.

A transform target block 310 may be subjected to both vertical transformand horizontal transform. Thus, a transform mode for the block 310 maycorrespond to the 2D transform mode. A transform target block 320 may besubjected to horizontal transform only without vertical transform. Thus,a transform mode for the block 320 may correspond to the horizontaltransform mode. In this case, since transform is performed on rows, noton columns, a transform method in the horizontal transform mode may bealso referred to as “transform on rows only.” A transform target block330 may be subjected to vertical transform only without horizontaltransform. Thus, a transform mode for the block 330 corresponds to thevertical transform mode. In this case, since transform is performed oncolumns, not on rows, a transform method in the vertical transform modemay be also referred to as “transform on columns only.” A transformtarget block 340 may not be subjected to transform. Thus, a transformmode for the block 340 is the non-transform mode.

In the foregoing transform modes, vertical transform and/or horizontaltransform may be or may not be omitted. Thus, these transform modes maybe also referred to as a transform skip mode (TSM). That is, thetransform skip mode may include the 2D transform mode, the horizontaltransform mode, the vertical transform mode and the non-transform mode.The 2D transform mode, the horizontal transform mode, the verticaltransform mode and/or the non-transform mode may be used as candidatesfor the transform skip mode for a transform target block.

In one exemplary embodiment, at least one of the 2D transform mode, thehorizontal transform mode, the vertical transform mode and thenon-transform mode may be used as a transform skip mode candidate for atransform target block. Here, one transform skip mode selected from aplurality of transform skip mode candidates may be applied to onetransform target block. The encoding apparatus may select a transformskip mode having a smallest cost value in view of rate-distortionoptimization (RDO) among the transform skip mode candidates. Here, theencoding apparatus may transform the transform target block based on theselected transform skip mode. That is, the encoding apparatus may applyone selected transform skip mode of the 2D transform mode, thehorizontal transform mode, the vertical transform mode and/or thenon-transform mode to the transform target block.

In addition, the encoding apparatus may encode information on theselected transform skip mode and transmit the information to thedecoding apparatus. The transform skip mode may be determined by a CU orTU. Here, when the transform skip mode is determined by a CU, theinformation may be transmitted by a CU. When the transform skip mode isdetermined by a TU, the information may be transmitted by a TU.

For instance, the information on the transform skip mode may betransmitted to the decoding apparatus through a transform skip modeindex. The transform skip mode index may be an index indicating thetransform skip mode to be applied to the transform target block amongthe transform skip mode candidates. The transform skip mode index may beallocated an index value based on the transform skip mode. Here, the 2Dtransform mode, the horizontal transform mode and the vertical transformmode may correspond different index values.

The decoding apparatus may decode the information about the transformskip mode (for example, the encoded transform skip mode index) which isreceived from encoding apparatus. Here, the decoding apparatus mayderive the transform skip mode to be applied to the transform targetblock based on the decoded information. The decoding apparatus maytransform the transform target block according to the derived transformskip mode. That is, the decoding apparatus may apply one derivedtransform skip mode of the 2D transform mode, the horizontal transformmode, the vertical transform mode and/or the non-transform mode to thetransform target block.

FIG. 4 is a flowchart schematically illustrating a transform process ofthe encoding apparatus according to an exemplary embodiment of thepresent invention.

Referring to FIG. 4, the encoding apparatus may determine a transformskip mode for a transform target block among a plurality of transformskip mode candidates (S410). Here, the transform skip mode candidatesmay include at least one of the 2D transform mode, the horizontaltransform mode, the vertical transform mode and the non-transform mode.Here, the encoding apparatus may select a transform skip mode having asmallest cost value in view of RDO among the transform skip modecandidates. A method of determining a transform skip mode candidateaccording to an exemplary embodiment will be described in detail.

Referring back to FIG. 4, the encoding apparatus may transform thetransform target block according to the determined transform skip mode(S420). That is, the encoding apparatus may apply one selected transformskip mode among the 2D transform mode, the horizontal transform mode,the vertical transform mode and the non-transform mode to the transformtarget block.

Further, the encoding apparatus may encode information on the transformskip mode applied to the transform target block and transmit theinformation to the decoding apparatus. For example, the information maybe transmitted to the decoding apparatus through a transform skip modeindex. Here, as described above, considering probabilities of transformskip modes, the encoding apparatus may allocate a short codeword to amore likely transform skip mode and a long codeword to a less likelytransform skip mode. A method of allocating a codeword for a transformskip mode according to an exemplary embodiment will be described indetail.

FIG. 5 is a flowchart schematically illustrating an inverse transformprocess of the decoding apparatus according to an exemplary embodimentof the present invention.

The decoding apparatus may decode a bitstream including the informationabout the transform skip mode (for example, the encoded transform skipmode index) which is received from encoding apparatus. In the bitstreamreceived from the encoding apparatus, a short codeword may be allocatedto a more likely transform skip mode, and a long codeword may beallocated to a less likely transform skip mode. A method of allocating acodeword for a transform skip mode according to an exemplary embodimentwill be described in detail.

Referring to FIG. 5, the decoding apparatus may derive a transform skipmode for an inverse transform target block among a plurality oftransform skip mode candidates (S510). Here, the transform skip modecandidates may include at least one of the 2D transform mode, thehorizontal transform mode, the vertical transform mode and thenon-transform mode. The decoding apparatus may use the same transformskip mode candidate as used in the encoding apparatus. Here, thedecoding apparatus may derive the transform skip mode for the inversetransform target block based on the decoded information (the informationon the transform skip mode, for example, the decoded transform skip modeindex). A method of determining a transform skip mode candidateaccording to an exemplary embodiment will be described in detail.

Referring back to FIG. 5, the decoding apparatus may inverse-transformthe inverse transform target block according to the derived transformskip mode (S520). That is, the decoding apparatus may apply one selectedtransform skip mode of the 2D transform mode, the horizontal transformmode, the vertical transform mode and/or the non-transform mode to theinverse transform target block.

Meanwhile, in the embodiments illustrated in FIGS. 4 and 5, the encodingapparatus and the decoding apparatus may use all of the 2D transformmode, the horizontal transform mode, the vertical transform mode and/orthe non-transform mode as transform skip mode candidates. Here, the 2Dtransform mode (and/or a transform skip mode index corresponding to the2D transform mode), the horizontal transform mode (and/or a transformskip mode index corresponding to the horizontal transform mode), thevertical transform mode (and/or a transform skip mode indexcorresponding to the vertical transform mode) and/or the non-transformmode (and/or a transform skip mode index corresponding to thenon-transform mode) may be allocated different codewords respectively.In this case, as described above, the encoding apparatus may allocate ashort codeword to a more likely transform skip mode and a long codewordto a less likely transform skip mode considering probabilities oftransform skip modes. Table 1 illustrates a method of allocating acodeword for a transform skip mode according to an exemplary embodiment.

TABLE 1 Row Column transforma- transforma- Codeword (CABAC TSM tion tionand/or CAVLC) Note TS0 O O 1 2D transform TS1 O — 01 1D transform TS2 —O 001 1D transform TS3 — — 000 Non-transform

In Table 1, TS0 represents the 2D transform mode. TS1 represents thehorizontal transform mode, and TS2 represents the vertical transformmode. TS3 represents the non-transform mode. Here, both the horizontaltransform mode and the vertical transform mode may correspond to a 1Dtransform mode.

For example, referring to Table 1, if the 2D transform mode mostfrequently happens, the 2D transform mode may be allocated a codeword“1.” Likewise, according to frequency, the horizontal transform mode maybe allocated a codeword “01,” the vertical transform mode a codeword“001,” and the non-transform mode a codeword “000.”

Even when vertical transform and/or horizontal transform is omitteddepending on transform skip modes, the same quantization matrix may beapplied as in the 2D transform mode. In this case, the encodingapparatus and the decoding apparatus may perform scaling on values inrows and/or columns not subjected to transform, which may be representedby Equation 1.y=(x*scale+offset)>>shift  [Equation 1]

Here, x may be an element in a non-transformed row and/or column, and ymay be a scaled value. “scale” may be a scaling factor. “offset” may bean offset value applied in scaling, and “shift” may be a bit shiftingvalue applied in scaling. Here, “offset” and “shift” may have the samevalues as an offset value and a bit transfer value applied whentransform is not omitted, for example, in the 2D transform mode.

Further, in Equation 1, the scaling factor applied to the encodingapparatus and the decoding apparatus may be determined depending on a TUsize. In one exemplary embodiment, the scaling factor according to theTU size may be set as listed in Table 2.

TABLE 2 N 4 8 16 32 Scale 128 181 256 362

Here, N (and/or N×N) may be a TU size, and scale may be a scalingfactor. Referring to FIG. 2, when a TU has an 8×8 size, a scaling factorvalue of 181 may be applied.

As mentioned above, a PU may not necessarily have a square shape buthave a rectangular shape. For example, in the inter mode, a PU may havea 2N*N, N*2N, 2N×nU, 2N×nD, nL×2N or nR×2N size (and/or shape). In SDIP,a PU may have a 2N*(1/2)N or (1/2)N*2N size (and/or shape). In thisinstance, since a particular transform skip mode may be less likely tohappen, the encoding apparatus and the decoding apparatus may not usethe less likely transform skip mode as a transform skip mode candidate,thereby enhancing encoding/decoding performance. Alternatively, theencoding apparatus may allocate a short codeword to the less likelytransform skip mode, thereby enhancing encoding/decoding performance.Accordingly, a method of determining a transform skip mode candidate anda method of allocating a codeword for a transform skip mode according toa PU size (and/or form) may be provided.

FIG. 6 illustrates a method of determining a transform skip modecandidate and a method of allocating a codeword to a transform skip modeaccording to a PU form in the inter mode.

FIG. 6 schematically shows a PU size (and/or form) in the inter mode.Referring to FIG. 6, one CU 610 may be divided into different sizes ofPUs according to properties of a picture and the like. FIG. 6 shows thatone CU 610 are divided into a plurality of PUs 620 in inter prediction.In the inter mode, the PUs may have sizes (and/or forms) of 2N*2N 621,2N*N 622, N*2N 623, N*N 624, 2N×nU 625, 2N×nD 626, nL×2N 627 or nR×2N628. Here, a PU with an N*N 624 size (and/or form) may be used only foran SCU as a minimum CU so as to prevent redundant computations forcalculating prediction costs.

Meanwhile, in the inter mode, probabilities of the horizontal transformmode and the vertical transform mode may vary on PU forms. Thus,different codewords may be allocated to transform skip modes (and/ortransform skip mode indexes) depending on PU forms. That is, codewordsallocated to transform skip modes (and/or transform skip mode indexes)may be determined based on PU forms.

In one exemplary embodiment, when a PU has a form of N*2N 623, energycompaction effect of horizontal transform may be smaller than energycompaction effect of vertical transform. Thus, the vertical transformmode may have a higher probability than the horizontal transform mode.In Table 1, the horizontal transform mode is allocated the codeword “01”and the vertical transform mode is allocated the codeword “001,” thatis, a more likely transform skip mode is allocated a longer codeword.Thus, in the PU with the form of N*2N 623, the codeword for thehorizontal transform mode and the codeword for the vertical transformmode are reset, thereby enhancing encoding performance. Table 3illustrates a method of allocating codewords to transform skip modes inthe PU with the form of N*2N 623 according to an exemplary embodiment.

TABLE 3 Row Column transforma- transforma- Codeword (CABAC TSM tion tionand/or CAVLC) Note TS0 O O 1 2D transform TS1 O — 001 1D transform TS2 —O 01 1D transform TS3 — — 000 Non-transform

In Table 3, TS0 represents the 2D transform mode. TS1 represents thehorizontal transform mode, and TS2 represents the vertical transformmode. TS3 represents the non-transform mode. Here, both the horizontaltransform mode and the vertical transform mode may correspond to a 1Dtransform mode.

Referring to Table 3, the horizontal transform mode may be allocated acodeword “001,” and the vertical transform mode may be allocated acodeword “01.” As described above, in the PU with the form of N*2N 623,the vertical transform mode may have a higher probability than thehorizontal transform mode, and thus the vertical transform mode may beallocated a shorter code than the horizontal transform mode.

Although Table 3 is described based on the PU with the form of N*2N 623,the present invention is not limited thereto. For example, in a PU witha form of nL×2N 627 or nR×2N 628 in addition to N*2N 623, the verticaltransform mode may also have a higher probability than the horizontaltransform mode. Accordingly, the vertical transform mode may beallocated a shorter code than the horizontal transform mode.

On the other hand, in PUs with 2N*N 622, 2N×nU 625 and 2N×nD 626 forms,the horizontal transform mode may have a higher probability than thevertical transform mode. Accordingly, the horizontal transform mode maybe allocated a shorter code than the vertical transform mode. Forexample, in the PU with the 2N*N 622, 2N×nU 625 and 2N×nD 626 forms, thesame codeword allocation method as in Table 1 may be used.

Meanwhile, as described above, since probabilities of the horizontaltransform mode and the vertical transform mode in the inter mode mayvary on PU forms, a number of transform skip mode candidates may bedetermined differently based on PU forms. That is, transform skip modecandidates for a transform target block may be determined based on a PUform corresponding to the transform target block.

In one exemplary embodiment, when a PU has a 2N*N 622 form, energycompaction effect of vertical transform may be smaller than energycompaction effect of horizontal transform, and thus the verticaltransform mode may have a lower probability than the horizontaltransform mode. Thus, in the PU with the 2N*N 622 form, the 2D transformmode, the horizontal transform mode and the non-transform mode may beused as transform skip mode candidates for a transform target block,excluding the vertical transform mode. In this case, one transfer skipmode among the 2D transform mode, the horizontal transform mode and thenon-transform mode may be applied to the transform target block. Table 4illustrates a method of allocating codewords to transform skip modeswhen the 2D transform mode, the horizontal transform mode and thenon-transform mode are used as transform skip mode candidates accordingto an exemplary embodiment.

TABLE 4 Row Column transforma- transforma- Codeword (CABAC TSM tion tionand/or CAVLC) Note TS0 O O 0 2D transform TS1 O — 10 1D transform TS3 —— 11 Non-transform

In Table 4, TS0 represents the 2D transform mode, TS1 represents thehorizontal transform mode, and TS3 represents the non-transform mode.Here, the horizontal transform mode may correspond to a 1D transformmode. Referring to Table 4, in the PU with the 2N*N 622 form, the 2Dtransform mode, the horizontal transform mode and the non-transform modemay be used as transform skip mode candidates.

Although Table 4 is described based on the PU with the form of 2N*N 622,the present invention is not limited thereto. For example, in PUs withforms of 2N×nU 625 and 2N×nD 626 in addition to 2N*N 622, the verticaltransform mode may also have a lower probability than the horizontaltransform mode. Accordingly, the 2D transform mode, the horizontaltransform mode and the non-transform mode may be used as transform skipmode candidates for a transform target block, excluding the verticaltransform mode.

Alternatively, in the PU with the form of N*2N 623, since energycompaction effect of horizontal transform may be smaller than energycompaction effect of vertical transform, the horizontal transform modemay have a lower probability than the vertical transform mode. Thus, inthe PU with the form of N*2N 623, the 2D transform mode, the verticaltransform mode and the non-transform mode may be used as transform skipmode candidates for a transform target block, excluding the horizontaltransform mode. In this case, one transform skip mode among the 2Dtransform mode, the vertical transform mode and the non-transform modemay be applied to the transform target block. Table 5 illustrates amethod of allocating codewords to transform skip modes when the 2Dtransform mode, the vertical transform mode and the non-transform modeare used as transform skip mode candidates according to an exemplaryembodiment.

TABLE 5 Row Column transforma- transforma- Codeword (CABAC TSM tion tionand/or CAVLC) Note TS0 O O 0 2D transform TS2 — O 10 1D transform TS3 —— 11 Non-transform

In Table 5, TS0 represents the 2D transform mode, TS2 represents thevertical transform mode, and TS3 represents the non-transform mode.Here, the vertical transform mode may correspond to a 1D transform mode.Referring to Table 5, in the PU with the form of N*2N 623, the 2Dtransform mode, the vertical transform mode and the non-transform modemay be used as transform skip mode candidates.

Although Table 5 is described based on the PU with the form of N*2N 623,the present invention is not limited thereto. For example, in a PU witha form of nL×2N 627 or nR×2N 628 in addition to N*2N 623, the horizontaltransform mode may also have a lower probability than the verticaltransform mode. Accordingly, the 2D transform mode, the verticaltransform mode and the non-transform mode may be also used as transformskip mode candidates for a transform target block, excluding thehorizontal transform mode.

In the foregoing embodiments illustrated in Tables 3 to 5, bit numbersused for encoding transform skip modes (and/or transform skip modeindexes) may be reduced. According to, encoding/decoding performance maybe enhanced.

FIG. 7 illustrates a method of determining a transform skip modecandidate and a method of allocating a codeword to a transform skip modeaccording to a PU form in SDIP.

FIG. 7 schematically shows a PU size (and/or form) in SDIP. Referring toFIG. 7, one CU 710 may be divided into different sizes of PUs accordingto properties of a picture and the like. FIG. 7 shows that one CU 710are divided into a plurality of PUs 720 in SDIP. In SDIP, the PUs mayhave sizes (and/or forms) of 2N*2N 721, N*N 723, (1/2)N*2N 725 or2N*(1/2)N 727. Here, a PU with an N*N 723 size (and/or form) may be usedonly for an SCU as a minimum CU so as to prevent redundant computationsfor calculating prediction costs.

In SDIP, since probabilities of the horizontal transform mode and thevertical transform mode may vary on PU forms, a number of transform skipmode candidates may be determined differently based on PU forms. Thatis, transform skip mode candidates for a transform target block may bedetermined based on a PU form corresponding to the transform targetblock.

In one exemplary embodiment, when a PU has a 2N*(1/2)N 727 form, energycompaction effect of vertical transform may be smaller than energycompaction effect of horizontal transform, and thus the verticaltransform mode may have a lower probability than the horizontaltransform mode. Thus, in the PU with the 2N*(1/2)N 727 form, the 2Dtransform mode, the horizontal transform mode and the non-transform modemay be used as transform skip mode candidates for a transform targetblock, excluding the vertical transform mode. In this case, one transferskip mode among the 2D transform mode, the horizontal transform mode andthe non-transform mode may be applied to the transform target block. Amethod of allocating codewords to transform skip modes when the 2Dtransform mode, the horizontal transform mode and the non-transform modeare used as transform skip mode candidates has been described above inTable 4, and thus a description thereof will be omitted herein.

Alternatively, in a PU with a form of (1/2)N*2N 725, since energycompaction effect of horizontal transform may be smaller than energycompaction effect of vertical transform, the horizontal transform modemay have a lower probability than the vertical transform mode. Thus, inthe PU with the form of (1/2)N*2N 725, the 2D transform mode, thevertical transform mode and the non-transform mode may be used astransform skip mode candidates for a transform target block, excludingthe horizontal transform mode. In this case, one transform skip modeamong the 2D transform mode, the vertical transform mode and thenon-transform mode may be applied to the transform target block. Amethod of allocating codewords to transform skip modes when the 2Dtransform mode, the vertical transform mode and the non-transform modeare used as transform skip mode candidates has been described above inTable 5, and thus a description thereof will be omitted herein.

In the foregoing embodiments, bit numbers used for encoding transformskip modes (and/or transform skip mode indexes) may be reduced.According to, encoding/decoding performance may be enhanced.

FIG. 8 illustrates a method of allocating a codeword to a transform skipmode according to a prediction direction in the intra mode.

As described above with reference to FIGS. 1 and 2, the encodingapparatus and the decoding apparatus may generate a prediction block byperforming intra prediction based on information on a pixel within acurrent picture. Intra prediction may be performed according to an intraprediction mode for a prediction target block. The intra prediction modemay include a DC mode, a planar mode, a vertical mode, a horizontal modeand an angular mode. The DC mode and the planar mode are non-directionalmodes, and the other modes are directional modes. Here, the angular modemay be a directional prediction mode other than the vertical mode andthe horizontal mode.

FIG. 8 illustrates a prediction direction of an intra prediction modeand a mode value allocated to each prediction direction. In FIG. 8, eachintra prediction mode have different prediction direction. Numbersallocated to each intra prediction modes may be referred to as modevalues.

Referring to FIG. 8, an intra prediction mode with a mode value of 0 maybe referred to as a planar mode. In the planar mode, reference pixelsused for prediction of a pixel value of a prediction target pixel may bedetermined based on a location of the prediction target pixel in aprediction target block. A prediction value of the prediction targetpixel may be derived based on the determine reference pixels. An intraprediction mode with a mode value of 1 may be referred to as a DC mode,in which a prediction block may be generated using an average pixelvalue of pixels neighboring to the prediction target block. In an intraprediction mode with a mode value of 26, prediction may be performed inthe vertical direction based on pixels values of neighboring blocks.Thus, the intra prediction mode with the mode value of 26 may be alsoreferred to as the vertical mode. In an intra prediction mode with amode value of 10 (horizontal mode, prediction may be performed in thehorizontal direction based on pixels values of neighboring blocks. Thus,the intra prediction mode with the mode value of 10 may be also referredto as the horizontal mode. In the other modes, prediction may beperformed based on pixel values of neighboring blocks according tocorresponding angles.

Probabilities of the horizontal transform mode and the verticaltransform mode may vary on an intra prediction mode (and/or predictiondirection) of a PU corresponding to a transform target block. Thus, adifferent codeword may be allocated to a transform skip mode (and/ortransform skip mode index) based on the intra prediction mode (and/orprediction direction) of the PU. That is, a codeword allocated to atransform skip mode (and/or transform skip mode index) may be determinedbased on the intra prediction mode (and/or prediction direction) of thePU corresponding to the transform target block.

In one exemplary embodiment, when the intra prediction mode of the PU isthe vertical mode, energy compaction effect of horizontal transform maybe smaller than energy compaction effect of vertical transform. Thus, inthis case, the vertical transform mode may have a higher probabilitythan the horizontal transform mode. In the embodiment illustrated withreference to Table 1, the horizontal transform mode is allocated thecodeword “01” and the vertical transform mode is allocated the codeword“001,” that is, a more likely transform skip mode is allocated a longercodeword. Thus, when the intra prediction mode of the PU is the verticalmode, the codeword for the horizontal transform mode and the codewordfor the vertical transform mode are reset, thereby enhancing encodingperformance. That is, when the intra prediction mode of the PU is thevertical mode, the vertical transform mode may have a higher probabilitythan the horizontal transform mode, the vertical transform mode may beallocated a shorter code than the horizontal transform mode. Anembodiment of allocating a shorter codeword to the vertical transformmode than to the horizontal transform mode is similar to the embodimentillustrated in Table 3, and thus a description thereof is omittedherein.

Alternatively, when the intra prediction mode of the PU corresponding tothe transform target block is the horizontal mode, the horizontaltransform mode may have a higher probability than the vertical transformmode. Thus, in this case, the horizontal transform mode may be allocateda shorter code than the vertical transform mode. For example, when theintra prediction mode of the PU corresponding to the transform targetblock is the horizontal mode, the same codeword allocation method as inTable 1 may be used.

FIG. 9 schematically illustrates a method of scanning a transformcoefficient based on a transform skip mode according to an exemplaryembodiment of the present invention.

FIG. 9 shows horizontal scanning 910, vertical scanning 920 and zigzagscanning 930 according to an exemplary embodiment. Although FIG. 9illustrates a scanning method (and/or scanning order) for a 4×4 blockonly, such a method may be applied regardless of block sizes, withoutbeing limited thereto.

In the embodiment of FIG. 9, inverse scanning may be also termed“scanning” for convenience of description as necessary, which will beeasily understood by a person having ordinary knowledge in the art.

As described above in FIG. 1, the encoding apparatus may performscanning to arrange a two-dimensional (2D) block of quantized transformcoefficients into a one-dimensional (1D) vector of transformcoefficients so as to enhance efficiency in entropy encoding. Also, asdescribed above in FIG. 2, the decoding apparatus may generate a 2Dblock of transform coefficients by scanning a 1D vector of decodedtransformed coefficients.

Here, the encoding apparatus and the decoding apparatus may determine ascanning method (and/or scanning order) based on a transform skip mode.That is, according to exemplary embodiments of the present invention,different scanning methods (and/or scanning orders) may be used based ona transform skip mode for a transform target block.

In one exemplary embodiment, when the transform skip mode is thehorizontal transform mode, residual signals are more likely to remain inthe vertical direction. Thus, when the transform skip mode for thetransform target block is the horizontal transform mode, verticalscanning 920 may be used for the transform target block. When thetransform skip mode is the vertical transform mode, residual signal aremore likely to remain in the horizontal direction. Thus, when thetransform skip mode for the transform target block is the verticaltransform mode, horizontal scanning 910 may be used for the transformtarget block. In transform skip modes other than the horizontaltransform mode and the vertical transform mode, zigzag scanning 930 maybe used to perform scanning.

FIG. 10 is a flowchart schematically illustrating an encoding methodaccording to an exemplary embodiment of the present invention.

Referring to FIG. 10, the encoding apparatus may generate a residualblock corresponding to a current block (S1010). As described above, theencoding apparatus may perform inter prediction and/or intra predictionon the current block, thereby generating a prediction blockcorresponding to the current block. Here, the encoding apparatus maygenerate a residual signal, that is, the residual block, bydifferentiating by a pixel between a pixel value of the current blockand a pixel value of the prediction block.

In FIG. 10, the encoding apparatus may transform the residual signal,that is, the residual block (S1020). The encoding apparatus maytranscode the residual signal by applying a transformation kernel, and atranscoding kernel may have a 2*2, 4*4, 8*8, 16*16, 32*32 or 64*64 size.In one exemplary embodiment, a transform coefficient C for an n*n blockmay be calculated by Equation 2.C(n,n)=T(n,n)×B(n,n)×T(n,n)^(T)  [Equation 2]

Here, C(n,n) is an n*n transform coefficient matrix, T(n,n) is an n*ntransformation kernel matrix, and B(n,n) is an n*n matrix of a residualblock.

When a transform coefficient is generated via transformation, theencoding apparatus may quantize the generated transform coefficient.

It may be determined through RDO which is transmitted among the residualblock and the transform coefficient. When prediction is properly done,the residual block, that is, the residual signal, may be transmittedwithout transcoding. The encoding apparatus may compare cost functionsbefore/after transcoding and select a method involving minimum costs.Here, the encoding apparatus may transmit information on a type of asignal (residual signal or transform coefficient) transmitted withrespect to the current block to the decoding apparatus.

Transform processes have been illustrated in the foregoing embodiments,and thus descriptions thereof are omitted herein.

Referring back to FIG. 10, the encoding apparatus may scan the transformcoefficient (S1030). Here, as described above, the encoding apparatusmay determine a scanning method (and/or scanning order) based on atransform skip mode. A method of determining a scanning order based on atransform skip mode has been described above, and thus a descriptionthereof is omitted herein.

When scanning is performed, the encoding apparatus may entropy-encodethe scanned transform coefficient and side information (for example,information on an inter prediction mode of the current block) (S1040).The encoded information may be formed into a compressed bitstream and betransferred or stored through an NAL.

Although the encoding method is described with a series of stages basedon the flowchart in FIG. 10, the present invention is not limitedthereto. Some stages of FIG. 10 may be carried out in different orderfrom described above or in parallel. Further, additional stages may beincluded between stages in the flowchart, or one or more stages may bedeleted from the flowchart of FIG. 10 within the scope of the presentinvention.

FIG. 11 is a flowchart schematically illustrating a decoding methodaccording to an exemplary embodiment of the present invention.

Referring to FIG. 11, the decoding apparatus may entropy-decode abitstream received from the encoding apparatus (S1110). For instance,the decoding apparatus may derive a prediction mode and a residualsignal of a current block based on a variable length coding (VLC) tableand/or CABAC. The decoding apparatus may obtain information on whether asignal received with respect to the current block is the residual signalor a transform coefficient and obtain the residual signal or a 1D vectorof transform coefficients for the current block. When the receivedbitstream includes side information needed for decoding, both thebitstream and the side information may be entropy-decoded.

In FIG. 11, the decoding apparatus may inverse-scan the entropy-decodedresidual signal or transform coefficients to generate a 2D block(S1120). Here, a residual block may be generated in the case of theresidual signal, and a 2D block of transform coefficients may begenerated in the case of the transform coefficients. When the transformcoefficients are generated, the decoding apparatus may dequantize thegenerated transform coefficients.

As described above, in inverse scanning, the decoding apparatus maydetermine a scanning method (and/or scanning order) based on a transformskip mode. A method of determining a scanning order based on a transformskip mode has been described above, and thus a description thereof isomitted herein.

Referring back to FIG. 11, the decoding apparatus may inverse-transformthe dequantized transform coefficients, thereby generating a residualblock (S1130). Inverse transformation may be represented by Equation 3.B(n,n)=T(n,n)×C(n,n)×T(n,n)^(T)  [Equation 3]

Inverse transformation has been described above, and thus a descriptionthereof is omitted herein.

When the residual block is generated, the decoding apparatus maygenerate a reconstructed block based on the generated residual block(S1140). As described above, the decoding apparatus may perform interprediction and/or intra prediction on a decoding target block togenerate a prediction block corresponding to the decoding target block.Here, the decoding apparatus may merge a pixel value of the predictionblock and a pixel value of the residual block by a pixel, therebygenerating the reconstructed block.

Although the decoding method is described with a series of stages basedon the flowchart in FIG. 11, the present invention is not limitedthereto. Some stages of FIG. 11 may be carried out in different orderfrom described above or in parallel. Further, additional stages may beincluded between stages in the flowchart, or one or more stages may bedeleted from the flowchart of FIG. 11 within the scope of the presentinvention.

Although methods have been described with a series of stages or blocksbased on the flowcharts in the aforementioned embodiments, the presentinvention is not limited to the foregoing sequence of the stages. Somestages may be carried out in different order from described above orparallel at the same time. Also, it will be understood by those skilledin the art that the stages illustrated in the flowcharts are notexclusive, additional stages may be included in the flowchart, or one ormore stages may be deleted from the flowcharts without affecting thescope of the present invention.

The present invention has been described with reference to the exemplaryembodiments, and the foregoing embodiments include various aspects ofexamples. Although all possible combinations may not be mentioned toillustrate various aspects, it will be appreciated by those skilled inthe art that changes, modifications and alternatives may be made inthese exemplary embodiments without departing from the principles andspirit of be the invention, the scope of which is defined in theappended claims and their equivalents.

The invention claimed is:
 1. A method of decoding a video signal havinga current block to be decoded with a decoding apparatus, comprising:obtaining residual coefficients relating to the current block from thevideo signal; obtaining inverse-quantized residual coefficients byinverse-quantizing the residual coefficients; determining, based on atransform skip mode index specifying a transform skip mode of thecurrent block, the transform skip mode of the current block, wherein thetransform skip mode of the current block is determined to be one of oneor more transform skip mode candidates, wherein the one or moretransform skip mode candidates include at least one of a 2D transformmode, a horizontal transform mode, a vertical transform mode or anon-transform mode, and wherein a number of the one or more transformskip mode candidates is different according to a size or a shape of thecurrent block; obtaining, based on the determined transform skip mode ofthe current block, residual samples from the inverse-quantized residualcoefficients; obtaining prediction samples of the current block by usingmotion information of the current block; and reconstructing the currentblock by using the residual samples and the prediction samples, whereinwhen the transform skip mode of the current block is determined to bethe non-transform mode, the residual samples are obtained by scaling theinverse-quantized residual coefficients in non-transformed rows and/orcolumns of the current block with a predetermined value.
 2. The methodof claim 1, wherein the scaling is performed using a bit shiftoperation.
 3. The method of claim 1, wherein the transform skip modeindex is transmitted, from an encoding apparatus, by a transform unit.4. The method of claim 1, wherein the 2D transform mode performs both ahorizontal transform and a vertical transform, the horizontal transformmode performs the horizontal transform only without the verticaltransform, the vertical transform mode performs the vertical transformonly without the horizontal transform, and the non-transform modeperforms none of the horizontal transform and the vertical transform. 5.The method of claim 1, wherein the motion information includes a motionvector and a reference index.
 6. An apparatus of decoding a video signalhaving a current block to be decoded, comprising: a decoding apparatusconfigured to: obtain residual coefficients relating to the currentblock from the video signal; obtain inverse-quantized residualcoefficients by inverse-quantizing the residual coefficients; determine,based on a transform skip mode index specifying a transform skip mode ofthe current block, the transform skip mode of the current block, whereinthe transform skip mode of the current block is determined to be one ofone or more transform skip mode candidates, wherein the one or moretransform skip mode candidates including at least one of a 2D transformmode, a horizontal transform mode, a vertical transform mode or anon-transform mode, and wherein a number of the one or more transformskip mode candidates is different according to a size or a shape of thecurrent block; obtain, based on the determined transform skip mode ofthe current block, residual samples from the inverse-quantized residualcoefficients; obtain prediction samples of the current block by usingmotion information of the current block; and reconstruct the currentblock by using the residual samples and the prediction samples, whereinwhen the transform skip mode of the current block is determined to bethe non-transform mode, the residual samples are obtained by scaling theinverse-quantized residual coefficients in non-transformed rows and/orcolumns of the current block with a predetermined value.
 7. Theapparatus of claim 6, wherein the scaling is performed using a bit shiftoperation.
 8. The apparatus of claim 6, wherein the transform skip modeindex is transmitted, from an encoding apparatus, by a transform unit.9. The apparatus of claim 6, wherein the 2D transform mode performs botha horizontal transform and a vertical transform, the horizontaltransform mode performs the horizontal transform only without thevertical transform, the vertical transform mode performs the verticaltransform only without the horizontal transform, and the non-transformmode performs none of the horizontal transform and the verticaltransform.
 10. The apparatus of claim 6, wherein the motion informationincludes a motion vector and a reference index.